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ABSTRACT 

A maximum likelihood estimation procedure is 
developed for the simple and the weighted additive models* The data 
are assumed to be taken by either one of the following methods: (1) 
categorical ratings--the subject is asked to rate a set of stimuli 
with respect to an attribute of the stimuli on rating scales with a 
relatively few observation categories; (21 pair comparisons^-the 
csubject is asked to judge which one of two stimuli presented at a 
time dominates the other in some respect; or (3) directional 
rankings — the subject is asked to rank order stimuli in a specific 
direction (i.e., from the smallest to the largest or the other way 
around). Although the procedure mainly focuses on these three 
experimental methods for data collection, it is by no means 
restricted to them. Practical uses of the procedure are reported with 
an emphasis on various advantages of the procedure as a statistical 
me t h od . ( A ut h or /R L) 
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A maximum likelihood estimation procedure is developelid for the 
simple and the weighted additive models. The data are assuiiied to 
be taken by either one of the following methods: categorical ratings, 
pair comparisons or directional rankings. Practical uses of the 
procedure are reported with an emphasis on various advantages of the 
procedure as a statistical method. 



* Paper presented to the Psychometric Society meeting at the 
University of Iowa, May 1980. 
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1. Introduct lea 

In this 7ap2r we 'scuss a maximuTn l_kelLhcod estii . Drocedure 

for additivlt7 analyr^^ from a variety o: nor.merric data Ij::! -sting 
methods for 7.1:: "-metric ridditivity analysis^ notably MONAK A ".ruskal, 
1965], ADDALS le Lc:^../, Younc^ & Takane, 1976] a-d ' -m^ ' 'i^-ane, 
Young & de Lee.w, 1910], are all based on the leas: .-.qu: principle, 
and are primarily descriptive in nature. The Tnaxir-.um li hood method 

developed in this paper, on "the other hand, allows varicn? ,:inds of 

statistical inferences inclu::ing tests of hypotheses about the model* 

2, The Model 

For illus tra::ive ::onv£r-.ience we only discuss the :T:o-factor case. 
The method is readily 2ener_lizable to higher order d^riigns. 

Let a. and B. denote £i:rditive effects of the i*"'' Jevel of Factor A 
and the j^^ level of Factor 3, respectively. We state the simple additive 
model as : 



(1) y,^ = + 3. . 

th 

where y. . is the predicted model value for the combination of the i 

th 

level of Factor A and the j level of Factor B. We also consider the 
weighted additive model which is stated as 



where Y^j^^ the subject-specific (subjeck k) model value for the (i, j) 
combination, and w^^ and w^^ are the weights attached to Factor A and 
Factor B, respectively, by subject k. This model accounts for individual 
differences in additivity by differential weightings of additive factors. 
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(The nat cf this -cdei :i.7ell as _3 relationship to the simple 
additiv Ddel (1 1^=: t'-II- r^scribei n: Takane, "oung & de Leeuw, [1980].) 
In orde o elimi-T^re -a" e ieterml '^'^'^ — ^ es in additive effects and 
Individ uz;. dif feiraiizei? \v^ei gir^rs ^ we may zisquire thazt 



(3) :(a. - ,3 )- = r and - I /nj" =^ n, 

i ^ Ti\ a j J ^ ; 



where r and :Eire the -'ano^rs of levels in Factor A and Factor B, 
respectively, 

3. The Data 

We assume that thr £ir:e collect - i by one i r.. following methods : 

categorical ratir.gs , p^izr : L_--irisons cr directioneLl rankings. In the 

categorical rating metnrd "^subject is asked to rat; a set of stimuli 
with respect to an atrrlbiiir- :f the stimuli on rating scales with a 
relatiirely few cbservEXlcn .—^gories . In the pair comparison method^ 
on the other hand, the suDje^iLiz is asked to judge which one of two stimuli 
presented at a time rr— n r nr~ zhe other in some respect. Finally, in the 
directional ranking :nHrhc±-Zu^ subject is asked to rank order stimuli in 
a specific direction (l.e rrom the smallest to the largest or the other 
way round). Althounr our rrrriadure mainly focuses on the above three 
experimental methods ±rr ■-rr— collection^ it is by no means restrricted to 
the above three. In fact 1j: las been shown [Takane & Carroll, in preparation] 
that treatments of conditionalities , missing data and tied observations in 
the directional ranking method allow a still wider range of data collection 
methods to be handled within the framework of the directional ranking method. 

4. The Method 

Maximum likelihood multidimensional scaling procedures have already 

4..:. 
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been developed for the three data collection methods mentioned above 
[Takane, 1978; Takane, 1980; Takane & Carroll, in preparation]. The 
construction of likelihood functions in the current procedure is very 
similar to that in its liDS counterparts with the difference being that 
the former fits the additive model, while the latter fits the distance 
model. Here we only briefly discuss general strategic schemes for the 
construction of likelihood functions specific to the data collection 
methods. Details as well as modifications of the basic schemes (e.g., 
a provision for tied observations) may be found in the references given 
ab o ve . 

4.1. Categorical ratings 
^ Let 

A. = y . ... + e. 

ijk ijk ijjk 

2 

where ^^^j^^ N(o,a^). The probability that stimulus O-jj^^ (defined by 

the i^^ level of Factor A and the j^^ level of Factor B as perceived by 

th 

subject k) is judged to be in the m category (C^) is stated as 

Pr(o, e C ) = Pr(b. . < X. < b. ) 
ijk m k(m-l) ijk km 



^ijkm 



^ijk(m-l) 



where b, and b, > are upper and lower boundaries of category m for 

km k(m-l) ^ 

subiect k> a,,- = (b, - y..^)/o. (m=l, M where M is the number 

^ * ijkm km ijk k ^ * 

of observation categories) , and where (J) is the standard normal density 
function. We may impose various restrictions on category boundaries 
[Takane, 1980]. 
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Let Z... denote the observed frequency with which o^ is put 
n by £ 
M) is given by 



categoi7 in by subject k. Then the joint probability of ^^^^^ (ni=l, 



M ^ijkm 

p.., = n p.., 



The joint likelihood of the total set of observations is, in turn, stc 
as 

4. 2 • Pair comparisons 

The probability that o^j^ is judged to be larger than Is g=~ 

by 

Pr(o. V , ) = Pr(X. > X- , ) 
11 kr Imk iik Imk 



^^ij Imk 



Hz) dz E p. .^^j^ 



where a,.., , = (y... - Y-x ,)/( 2 Let Z.,- , be the frequency xv: 

ijlmk ijk ^Imk^ ^ k"^ ijlmk ^ ^ 

which o... is judged larger than O- , out of N..- , replications. T 
ijk JO ^ i^y- ijlmk ^ 

likelihood of the total set of observations can then be written as 



L = n p.!'iji">i^ (1 - p. , )"'^^'"'' ^^^^""^ 

ij Imk ^ij Imk 



[Takane, 1978]. 



4.3. Directional rankings 

Let ^ ^k"^^^ ****/^^k^^ observed ranking. Let y^^^ 

the model value corresponding to . We assume that the ranking is 
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be 
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Dbtalr.i: from zhr .iirgest element to the smallast by r ccessive first 
hoiccs The --r: ,:;:^ity of the m first ch: ice, 



(m) _ ,3) V (nri-l) ^(m) v 0' 



k k k 

,3 giver, r - an a-r-rr— riate integral of the multivaria-ie r..:.-~ 1 . istribution, 
vraich i i:pzproyi±T.^zz^± by 

aicp Cs y ) 
(m) k k 5 



I exp(s^y^^^ 



where i in apprrrrrlinately ir/C 30^), For the likelihoc. of a rz-nking we 

take a -oduct zz ; i.e., p^^ = H p^'"^ Finally, the joint likelihood 

Tn=l' 

of mul. le ran:::::Tigs obtained from different subjects is defined by the 

produc:- of P ovbt k. For treatments of ties see Takane and Carroll [in 
^ k 

preparation] . 



4. 4. Numerical method 

The log likelihood may be optimized by various numerical methods. The 
current MAXADD, a FORTRAN program to perform the analysis described in this 
paper, uses Fisher's' scoring algorithm. From a limited experience of the 
author the convergence is very quick and smooth. 

5 . Some Et ^i pirical Results 

We present some empirical results obtained by the method proposed in 
this paper. The data we analyze pertain to developmental change in the 
structure of weights attached to height and width of rectangles in large- 
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ness judgments. Kemplf: [1971] constructed a set of irO rectan : ?-S 
factoriall^ combining : lei^^ht levels and 10 widt^i le\'els each in, ing 
from 10 zs. - es to. 14.5 iir.zhes in half-inch intervals. Four p^rou-^s of 
ch: :ren 3^^, 5^' ..:nd """^ graders) jiidgec each of the ]00 tlmuli 

as ^Th' ZR^r it looked lai ^ or "small" (twc— cate9;orY rating udprienis) • 

i<3 rcviously anal zed : same set of data using a different procedure 
caLI ZZ'ALS [Takane. Yol.:. y. de LeeuWj 1980]. The first figure shows 
th^- -'r e in weights ccta: .ec to height and width of rectangles as a 
frrtzri f age groups (as -evealed by the WADBALS procedure) . We can see 
a f ::^ir:j:^ Dnsistent tender^ ::hat the weight attached to height decreases 
wiLh a>:e For this analym :e aggregated the data by age groups by 
c .nting Che frequency wir:r .uhich each rectangle is judged as "large". 
T:' ? frHcuency was used ordinal measure of the perceived largeness 

or rectangles. The primn* ' focus of this analysis, however, was on the 
grrup differences dlsreg^—ding the individual differences within the groups. 
This may not be justifiable, so we have performed MAXADD analyses of indiv- 
idual data. 

The first table summarizes the results of separate MAXADD analyses 
of Kempler's data by grade. The first column represents the weighted 
additive model (WAM) with individual differences in dispersion (o^) , the 
second column the simple additive model (SAM) with and the last column 
SAM without individual differences in dispersion (a). In all analyses 
category boundaries were allowed to vary over individuals. Three figures 
are reported in each cell of the table. The top one is the log likelihood 
multiplied by -2, the middle one is the effective number of parameters in 
the fitted model (d.f.), and the bottom the value of the AIC statistic 
[Akaike, 1974], which is defined by 
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AIC = -2 X log likelihood + 2 x d.f. of the niodel. 
The best fitting model is the one with a TninimuTn JC value. VJe see that 
the weighted additive model is the best in all ag^ gr-nnpc? according ro this 
criterion. There seems to be substantial individual differences in the 
weight structure within the age groups. We can alsr^ observe that the 

differences in the AIC values between WAM and SA]^; t nd to diminish as 

^ ^ th 
Vve go from the l"* graders to the 7 graders. 

This point may be more clearly seen in the ne::::: four figures which 
display estimated individual weights for each aee eroup. One tendency is 
evident; the plots of weight estimates tend to ::onverge in uhe ml : cile as 
the age goes up. For example, in grade 1 there are auite a few c" ildren 
who put a disproportionately large weight on haiight (including thrse two 
who totally ignore the width dimension), while rhose extreme sub-^ects 
decrease in number and also in its degree until the majority of subjects 
put approximately equal weights on both height and x^-dth of rectangles. 
So the group differences we found previously with the WADDALS analysis of 
Kempler^s data seem to be largely due to the difference in the constitution 
of the groups, which are heterogeneous in themselves ^ but which tend to get 
more homogeneous with age. 

We have not done a joint analysis of all data in all age groups. The 
reason is simply that there are too many subjects. (For WAM with individual 
dispersions and category boundaries we need to estimate up to 300 parameters. 
Consequently we had to resample portions of the available data set to examine 
the goodness of fit of the model in joint analyses. (The algorithm is being 
revised so that MAXADD can accommodate a problem of this size, however.) 
Two sets of data were subsamoled, each consisting of data from 24 subjects. 
(6 in each age group). A summary of the results are shown in the next table. 



d 



8. 

(The entries z zhis table are analogous to those in the previous table.) 
For both srcs .: data the joint analysis with WAM with individual disper- 
sions and boindazrLes outperforms the others, indicating that the additive 
effects may be assumed common to all age groups, though the weights are 
different r\oz only for different age groups but also for individuals 
within the groups. 
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Individual 

Diffx3rences 

Weights 




Grade 



Change In weights attached to height and width of rectangles 
as a function of age-groups. 
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INDIVIDUAL DIFFERENCES HEIGHTS ATTACHED TO HEIGHT AND HIDTH 




INDIVIDUAL DIFFERENCES WEIGHTS ATTACHED TO HEIGHT AND WIDTH 




WIDTH 



INDIVIDUAL DIFFERENCES WEIGHTS ATTACHED TO HEIGHT AND WIDTH 
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Comparisons of separate analysis by grade and joint analysis 





Separate ANALYSIS (by 


grade) 


Joint analysis 




WAM 


SAM 


SAM 


WAM 


SAM 


SAM 




a 

K 




a 




a 

K 


a 


Set 1 


2992. i} 


3130.9 


3185.5 


3050.0 


3272.6 


3371.2 




136 


120 


96 


88 


65 






3264. 


3370.9 


3377.5 


3226.0* 




3^155. 2 


Set 2 


2562. 


2742.1 


2802.5 


263i|.5 


2868.1 


2930.5 




136 


120 


96 


88 


66 






283^1. 


2982.1 


299^1. 5 


2810.5* 


3000.1 


3m, 5 



Legend: 

-2 X log likelihood (+ const.) 

D.F. of the model 

AIC (+ const.)' 
* Minimum AIC solution 

!0 
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